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A NOTE  ON  THE  STABILITY  OF  THE 
JOB  DESCRIPTIVE  INDEX  (j.  D.  I.)’ 

Benjamin  Schneider  H.  Peter  Dachler 

University  of  Maryland,  College  Park 

Increasingly  social  scientists  have  utilized  attitude  measures  as 
predictors,  criteria,  or  in  other  time-based  ways  (e.g.,  periodic  sur- 
veys) rather  than  as  static  assessment  devices.  When  a measure  is 
employed  in  a time-based  mode,  stability  ("retest  reliability"),  not 
internal  consistency,  is  the  critical  index  of  reliability.  This  is 
true  because  the  degree  to  which  a measure  correlates  with  itself  over 
time  is  one  of  the  limiting  factors  on  the  potential  for  the  measure  to 
correlate  with  (predict  or  be  predicted  by)  another  measure.  Over  time, 
a measure  cannot  correlate  with  another  measure  greater  than  the  square 
root  of  stability  as  indexed  by  the  Pearson  r_  (cf.  Nunnally,  1967). 

A carefully  developed  and  frequently  used  attitude  measure  in 
organizational  research  is  the  Job  Descriptive  Index  (Smith,  Kendall, 

S Hut  in,  1969).  This  measure  has  been  used  in  probably  hundreds  of 
studies.  The  methodological  rigor  employed  during  its  construction  and 
validation,  its  normative  data,  its  relatively  low  required  reading 
level  (about  7th  grade),  and  the  fact  that  it  assesses  satisfaction  with  | 


five  of  the  most  basic  or  generally  most  visible  aspects  of  a person’s 
work  role  (work,  pay,  promotion,  supervision,  and  co-workers),  most 


The  authors  wish  to  thank  Patricia  C.  Smith  for  permission  to  use  the 
JDI  in  this  study  and  John  Parkington  and  Bruce  Katcher  for  helping  with  the 
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likely  account  for  the  JOI's  attractiveness  to  researchers. 

Considerable  data  on  the  validity  of  the  JDI  is  now  available  (cf. 
Locke,  1976)  in  addition  to  the  external  and  convergent  and  discriminant 
validity  (Campbell  & Fiske,  1959)  data  presented  in  the  original 
publication  of  the  measure  (Smith  et  al.,  1969)*  However,  there  is 
very  little  information  about  the  stability  of  the  JDI.  Smith  et  al . 
(1969,  p.  75)  found  stability  correlations  from  AS  to  .75  on  ^5  em- 
ployees over  a period  of  three  years.  The  authors  are  not  aware  of 
any  other  stability  data  on  the  JOI  in  the  literature.  As  a result 
of  a fortuitous  opportunity  to  use  the  JDI  on  a large  and  very  diverse 
sample  of  working  adults,  this  study  further  investigates  the  dimen- 
sional stability  of  the  JDI. 

Method 

Sample 

As  part  of  a larger  periodic  survey  of  employee  panels  in  an 
Atlantic  coast  utility,  the  JDI  was  administered  twice  within  a period 
of  16  months.  There  were  8L7  employees,  5^i  management  and  306  non- 
management, who  participated  In  both  administrations;  they  constitute 
the  sample  of  interest  in  the  present  study. 

Both  the  management  and  non -management  personnel  were  drawn  from 
all  five  divisions  of  the  geographically  dispersed  utility  and,  within 
each  division,  all  five  departments  (ranging  from  sales  to  engineering) 
were  included.  In  addition,  both  samples  Included  a wide  range  of  tenure 
in  the  company  (about  60^  of  the  managers  had  more  than  15  years 
tenure  in  the  company,  whereas  of  the  non-management  people  passed 
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that  tenure  mark)  . 

The  management  sample  included  102;  minority  members  and  70%  were 
male.  All  levels  of  management  were  represented.  The  non -management 
sample  was  characterized  by  20%  minority  members,  about  50%  males,  and 
people  from  all  non-management  positions  ranging  from  janitorial  to 
profess i onal -non -management . 

Procedure 

The  JDI  was  part  of  a larger  survey  in  both  admin i s t rat  ions , 
appearing  last  within  the  questionnaire  in  both  cases.  The  typical 
employee  probably  spent  between  30  and  AO  minutes  completing  the 
entire  survey  which  they  received  at  the  work  place.  Because  employees 
identified  themselves  with  Social  Security  numbers,  the  correlational 
analyses  to  be  presented  v;ere  possible.  Great  care  was  taken  in  ob- 
taining the  trust  and  cooperation  of  panel  members. 

Results  and  Discussion 

Table  1 presents  the  complete  matrix  resulting  from  the  inter- 
correlations of  the  tuo  administrations  for  managerial  personnel  as 
the  lower  triangle  entries;  in  the  upper  triangle  the  same  data  for 
the  non -management  sample  are  presented.  The  pattern  of  stability  co- 
efficients are  quite  high  and  quite  similar  for  both  samples  with  an 
average  r_^^  for  managers  equal  to  .56  and  for  non-managers,  .58.  These 
stability  coefficients  are  of  similar  magnitude  to  those  obtained  by 
Smith  et  al . in  the  three-year  study  noted  earlier. 

For  both  the  management  and  non -management  samples  in  the  present 
project,  stability  is  lowest  for  satisfaction  with  supervision  (.A6  for 


JDI  Scale  Intercorrelations  for  Two  Administrations  Separated  by 
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management,  AS  for  non-management).  However,  even  at  this  level  of 
stability,  it  is  clear  that,  at  least  for  this  sample,  the  JDl , relative 
to  other  criteria,  is  quite  stable  and  should  prove  useful  in  time-based 
studies.  Schmidt  and  Hunter  (1977),  for  example,  report  an  average  ex- 
pected re-test  reliability  for  criteria  in  personnel  selection  studies 
of  .60,  approximately  the  results  obtained  in  the  present  research. 

Some  other  data  of  potential  interest  in  terms  of  dimensional 
stability  is  revealed  in  the  tables,  if  one  treats  the  two  administra- 
tions of  the  JDl  separated  by  16  months  as  two  methods  of  assessing 
different  job  facet  satisfaction.  This  assumption  allows  one  to  examine 
the  time^/time^  (methods)  and  satisfaction  facets  (traits)  matrix  for 
dimensional  stability  of  the  different  JDl  components,  analogous  to  the 
logic  of  convergent  and  discriminant  validity  (Campbell  6 Fiske,  1959). 

In  doing  so,  one  notes  that  in  every  case:  (1)  The  heteromethod- 
monotrait  stability  diagonals  (timej/time2 , same  traits  ) are  higher  than 
the  heteromethod-heterot ra i t off-diagonal  (t ime ^ /t ime^ , dissimilar  traits) 
correlations;  and,  (2)  The  stability  diagonals  are  stronger  than  the 
monomethod-he terot ra i t correlations  (revealed  in  the  timej  intercorrela- 
tion matrix  and  time^  intercorrelation  matrix).  In  other  words,  not  only 
do  the  JDl  facet  satisfaction  scales  reveal  stability  over  time  but  they 
retain  their  relative  independence  over  time, 

A summary  procedure  for  interpreting  these  kinds  of  data  is  avail- 
able through  the  ANOVA  computations  presented  by  Kavanagh,  MacKinney  and 
Wolins  (1971).  This  procedure  allows  for  an  estimate  of  the  variance 
in  the  mui ti trai t-mul t imethod  matrix  attributable  to  convergent  validity, 
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discriminant  validity,  method  bias,  and  error.  If  one  conceptualizes 
two  administrations  of  the  same  measure  as  two  methods,  then  convergent 
stability,  following  the  Kavanagh  et  al.  arguments,  is  inferred  from 
respondent  variance  which  indicates  the  overall  degree  of  respondent 
agreement  across  the  first  and  second  administration  of  the  JDI  and  over 
the  five  dimensions  of  the  JDI.  Discriminant  stability  is  indicated  by 
the  Respondents  X JDI  dimensions  variance  which  shows  the  degree  of  dis- 
crimination among  the  five  JDI  dimensions  over  time.  Method  bias  is 
assessed  on  the  basis  of  Respondents  X Administration  variance  which 
indicates  the  amount  of  variance  due  to  the  particular  self-report  method 
of  the  JDI . 

Table  2 shows  the  results  of  this  summary  analysis  for  the  management 
and  non-management  samples.  The  main  effects  and  interactions  are  all 
statistically  significant,  indicating  convergent  stability,  discriminant 
stability,  and  method  bias.  However,  looking  at  the  four  variance  com- 
ponents, method  bias  is  negligible  for  both  samples  in  comparison  to  the 
other  sources  of  variance.  Furthermore,  the  variance  components  for 
Respondents  (convergent  stability)  and  for  Respondents  X JDI  dimensions 
(di scr iminab i 1 i ty  of  the  JDI  dimensions  over  tine)  are  approximately  equal, 
and  similar  in  magnitude  to  error  variance.  These  facts  suggest  that  the 
JDI  over  time  is  stable,  that  its  stability  is  matched  by  its  capacity 
to  distinguish  between  the  five  dimensions  of  satisfactions,  that  the 
method  bias  of  the  JDI  is  relatively  insignificant,  and  that  from  the 
perspective  of  practical  significance,  the  JDI  over  the  two  administra- 
tions accounts  for  as  much  known  sources  of  variance  as  unknown  (error) 


Analyses  of  Variance  of  Correlations  From  Table 
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vari ance . 

An  Issue  that  is  difficult  to  resolve  is  raised  in  attempting  to 
estabiish  the  theoretical  meaning  of  the  convergent  and  discriminjnt 
stability  results  obtained  with  the  JDI.  Thinking  about  a test-retest 
correlation  coefficient  as  an  index  of  reliability  assumes  that  the 
true  scores  (Nunnally,  1967)  are  constant.  However,  satisfaction  con- 
ceived as  a resultant  of  the  interaction  between  relatively  stable  per- 
sonal characteristics  (i.e.,  frame  of  reference,  needs,  values)  and 
relatively  dynamic  environmental  characteristics  (cf.  Locke,  1976) 
makes  the  assumption  of  a constant  true  satisfaction  score  problematic. 

The  authors  do  not  know  of  any  intra  or  extra-organizational  changes 
during  the  l6  months  interval  between  the  two  JDI  administrations  that 
might  differently  affect  JDI  dimension  scores  for  some  subgroups  but  not 
others.  If  all  respondents  in  a sample  changed  equally  on  the  JDI  di- 
mensions, there  would  be  no  problem  in  interpreting  the  stability  corre- 
lations. However,  if  differential  changes  among  subgroups  within  a 
sample  did  occur,  one  cannot  know  the  meaning  of  the  magnitude  of  the 
observed  stability  coefficients.  Thus,  under  the  assumption  of  trait 
stability,  the  obtained  stability  coefficients  may  be  too  low.  Under 
the  assumption  of  dynamic  traits,  the  obtained  stability  coefficients 
may  be  too  high. 

Given  our  still  meager  understanding  of  the  dynamic  nature  of 
satisfaction,  there  exists  no  basis  for  a satisfactory  solution  to  the 
theoretical  meaning  of  the  obtained  JDI  time  based  convergent  and  dis- 
criminant stability  results.  This  lack  of  theoretical  specification 
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regarding  the  dynamic  nature  of  satisfaction  and  the  resultant  ambiguity 
regarding  the  meaning  of  test-retest  reliability  of  dynamic  traits,  sug- 
gests a neglected  domain  in  the  definition  and  measurement  of  constructs 
1 i ke  sat i s fact  ion . 

However,  with  respect  to  the  utility  of  the  JDI  as  a measure  of 
satisfaction,  the  reported  results  seem  to  allow  the  narrow  conclusion 
that  the  JDI  scales  have  some  utility  in  predicting  or  being  predicted 
by  other  measures  over  time. 
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